Model Based Fusion for Multisensor Target Recognition

A multisensor feature-based fusion approach to target recognition using a framework of model-theory is proposed. The Best Discrimination Basis Algorithm (BDBA) based on the best basis selection technique and the Sensory Data Fusion System (SDFS) based on logical models and theories are applied for feature extraction. The BDBA selects the most discriminant basis. The SDFS rst selects features, which are interpretable in terms of symbolic knowledge about the domain, from the most discriminant basis determined for each sensor separately. Then, it fuses these features into one combined feature vector. The SDFS uses formal languages to describe the domain and the sensing process. Models represent sensor data, operations on data, and relations among the data. Theories represent symbolic knowledge about the domain and about the sensors. Fusion is treated as a goal-driven operation of combining languages, models, and theories related to diierent sensors into one combined language, one combined model of the world and one combined theory. The results of our simulations show that the recognition accuracy of the proposed Automatic Multisensor Feature based Recognition System (AMFRS) is better than the recognition accuracy of a system that performs recognition using Most Discriminant Wavelet Coeecients (MDWC) as features. The AMFRS utilizes a model-theory framework (SDFS) for feature selection, while MDWC are selected from all the most discriminant bases determined for each sensor using a relative entropy measure.